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(54) A method for encoding and decoding moving picture signals 



(57) In the method lor encoding and decoding digital 
moving picture signals of this invention, information for 
one frame is encoded correspondingly to a spatial hier- 
archy of a frame, subframes and blocks. A subframe 
time position number and a subframe space number are 



attached to an identifier of each of the subframes. 
Thereby appropriate decoding of the subframes can be 
resumed immediately after an error occurs. The sub- 
frame identifiers are placed at a certain inten/al in the 
bit stream. 
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Description 

The present invention relates to a method for en- 
coding and decoding digital moving picture signals tor 
use in TV phones. TV conferences and the like. 

In a general method for encoding digital moving pic- 
ture signals, a frame of inputted moving picture is divid- 
ed into plural blocks each composed of N x M pixels, 
and processes of motion detection, prediction, orthogo- 
nal transform, quantization, variable length coding, etc. 
are conducted on each block. 

In a general method for decoding digital motion pic- 
ture signals, blocks each composed of N x M pixels are 
regenerated in a reverse procdyre, that is, processes of 
variable length decoding, reverse quantization, reverse 
orthogonal transform, motion compensation, etc. 

The above general encoding method and decoding 
method for encoding and decoding digital moving pic- 
ture signals enable removal of redundancy contained in 
moving picture signals, and efficient communication and 
storage of a moving picture with less information. 

In the general encoding method and decoding 
method for encoding and decoding digital moving pic- 
ture signals, the processes are conducted on each pixel 
block, as stated above. It is general that a set of pixel 
blocks forms a subf rame and a set of subframes forms 
a frame, which are units processed in the general en- 
coding and decoding method. 

Hereinafter, encoding and decoding of each block, 
subf rame and frame will be described by wayt of an ex- 
ample of a general encoding and decoding method for 
encoding and decoding digital moving picture signals 
with reference to ITU-T Recommendation H.261 (here- 
inafter, referred simply H.261) made on March, 1993. 

H.261 defines an encoding method and a decoding 
method for encoding and decoding luminance signals 
and color difference signals, separately, of digital mov- 
ing picture signals. However, description will be made 
of only the luminance signals, for the sake of conven- 
ience. Basically, the encoding method and decoding 
method for encoding and decoding the luminance sig- 
nals are not different from those for the color difference 
signals. 

As shown in FIG. 1 , one frame 101 of digital moving 
picture signals is composed of 352 x 288 pixels accord- 
ing to H.261 . The frame 101 is divided into twelve sub- 
frames 102 called GOBs (Group of Blocks) each com- 
posed of 176 x 48 pixels (hereinafter, the subf rame in 
the description of the prior art will be referred a GOB). 
Further, the GOB 102 (subf rame) is divided into thirty 
three blocks 103 called macro blocks each composed 
of 16 x 16 pixels. 

The encoding method according to H.261 defines 
that encoded information for one frame is corresponded 
to a spatial hierarchical structure such as the frame 1 01 , 
GOBs 102 and macro blocks 103 described above, as 
shown in FIG. 2. 

In FIG. 2, a part enclosed in a rectangle shows en- 



coded information, and the number of coding bits is 
shown under each of the rectangles. In FIG. 2. arrows 
show linkages of the encoded information. A series of 
encoded moving picture signal sequence as this is 

5 called a bit stream 104. 

In the bit stream 104 according to H.261 shown in 
FIG. 2, a part including all encoded information for one 
macro block 103 is called a macro block layer 103S, a 
part including all encoded information for one GOB 1 02 

10 is called a GOB layer 102S, and a part including all en- 
coded information for one frame 101 is called a frame 
layer 101S. 

f^eanings of the encoded information in each of the 
layers shown in FIG. 2 are given below: 
IS Frame layer 101 S 

PSC (20 bits): a frame identifier 105; a unique code 
by which an encoding method can be always iden- 
tified, expressed as "0000 0000 0000 0000 0001"; 
20 TR (5 bits): a frame number 106; indicating a lime 
position in which this frame 101 should be dis- 
played; 

PTYPE (6 bits): frame type information 107; various 
information about the frame 101; 
2S PEl (1 bit): extension data insertk>n information 1 08; 
a flag representing presence of following PSPARE 
109; 

PSPARE (8 bits): extension data; 
GOB layer 102S (subf rame) 

30 case (16 bits): a GOB identifier 110; a unique code 
by which a decoding method can be always identi- 
fied, expressed as "0000 0000 0000 0000"; 
GN (4 bits): a GOB number 111; indicating a spatial 
position of this GOB 102 within the frame 101; 

3S GQUANT (5 bits): quantization characteristic infor- 
mation 112; indicating a quantization characteristic 
when a macro block 1 03 in the GOB 1 02 is encoded; 
GEI (1 bit): extension data insertion information 
113; a flag representing presence of following 

40 GSPARE 114; 

GSPARE (8 bits): extension data 114. 

Incidentally, the encoded information 115 of the 
macro block layer which is the lowest hierarchy in FIG 

45 2 is generated in the encoding method of motion detec- 
tion, prediction, orthogonal transform, quantization, var- 
iable length coding, etc., as described before, whose 
coding bit number is not fixed. The number of coding 
bits of the macro block layer 103S, in general, increases 

so if a spatial level of pixels included in the macro block 
103 changes largely or a time level of pixels included in 
the macro block 103 having the same spatial positions 
changes largely. Such macro bkx;k 103 is, hereinafter, 
referred a macro block 103 which is difficult to be en- 

ss coded. 

To the contrary, if a level of pixels included in the 
macro block 103 is steady in relation to space and time, 
the number of coding bits of the macro block layer 103S 
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remarkably decreases, or sometimes becomes zero. 
Such macro block 103 is hereinafeter referred a macro 
blocK^ 103 which is easy to be encoded. 

In the decoding method according to H.261. the 
PSC 105 which is an identifier of the frame layer 101 S s 
is first found out from the bit stream 104. Incidentally, a 
state where a decodable code has been successfully 
found out is said that synchronization is established. 
When the PSC 105 is found out from the bit stream and 
synchronization of the frame layer 101 S is established, io 
it can be identified that the bit stream 104 until the next 
PSC 1 05 appears is encoded inf omiation for one frame. 
Further, a time position in which the frame 101 com- 
posed of 352 X 288 pixels obtained by decoding the bit 
stream 104 for that one frame can be obtained by ex- is 
amining the frame number 106 following the PSC 105. 

After the establishment of the frame layer, a GBSC 
110 that is an identifier of the GOB layer 102S is found 
out from the following bit stream 104 in the encoding 
method according to H.261 , When synchronization of 
the GBSC layer is established, it can be identified that 
the bit stream 104 until the next GBSC 110 appears is 
encoded information for one GOB 102. Further, a spatial 
position of the GOB 102 composed of 176 x 48 pixels 
obtained by decoding the bit stream 104 for that one ^5 
GOB 102 in a frame 101. in which the GOB 102 should 
be placed, can be obtained by examining a GN 111 
which is a GOB number following the GBSC 110. 

In the decoding method according to H.261 . a bit 
stream 1 04 of a following macro block layer 1 0SS is de- so 
coded after the establishment of the GOB layer 102s. 
The decoding method of the macro block layer 103S is 
a procedure to regenerate a macro block 1 03 composed 
of 16 X 16 pixels in processes of variable length decod- 
ing, reverse quantization, reverse orthogonal transform, 55 
motion compensation, etc., as described before. It 
should be here noted that the macro block layer 103S 
has no unique code by which a decoding method can 
be always identified dissimilarly to the PSC 105 or BG- 
SC 110. and encoded Information of each macro block 4o 
is composed of undefined length bits of a variable length 
code. 

As shown in FIG. 3, in the GOB (subframe) layer 
102S, the encoded information from the first macro 
block 115 to the thirty third macro block 11633 »s ex- 
pressed as a series of variable length codes without a 
unique code. If decoding of the macro block encoded 
information is initiated from a point indicated by A in FIG. 
3, and successively conducted in the order of the first, 
the second. ... the nlh, ... the thirty third macro blocks, so 
it is possible to regenerate all the macro blocks 103 in 
the GOB layer 102S. However, if the decoding of the 
macro block encoded information is initiated from a point 
indicated by B or C in FIG. 3, it is impossible to identify 
a point from which encoded information 1 1 5 of one mac- ss 
ro block starts, which leads to a failure of establishing 
synchronization. In which case, the decoding and re- 
generating all macro blocks 1 03 become unfeasible until 
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the next GBSC 110 appears. In other words, the GBSC 
110 also represents a starting point of decoding the 
macro block layer 103S. 

Finally, in the decoding method according to H.261 , 
the GOB 102 which is a set of regenerated macro blocks 
103 is placed in a spatial position within a frame 101 
directed by GN ill , and the frame 100 which is a set of 
the regenerated GOBs 102 is placed in a time position 
directed by TR 106. 

As above, it is possible to decode one frame 101 of 
digital moving picture correctly in relation to space and 
time according to H.261 . 

However, the above general method for encoding 
and decoding digital moving picture signals has a draw- 
back that if a part of a bit stream 104 lacks or an error 
occurs therein, it might be impossible to accurately de- 
code all subframes (GOBs) 102 in relation to time until 
synchronization of the next frame layer 101S is estab- 
lished. 

The reason of the above is that codes which can be 
identified at all times in the bit stream 104 are only the 
PSC 105 which is a frame identifier and the GBSC 110 
which is a subframe identifier in the general decoding 
method. If a part of the bit stream 104 lacks or an error 
occurs therein, it is impossible to recover synchroniza- 
tion of the decoding until the next GBSC 110 appears 
so that the decoding becomes unfeasible. Even if the 
next G BSC 1 1 0 appears, the bit stream 1 04 of that sub- 
frame layer 102S cannot be correctly decoded in rela- 
tion to time. This will be understood from FIG. 4. 

FIG. 4 shows an example where the fifth GOB IO25 
in the nth frame 1 01 n through the sixth GOB 1 02e in the 
(n+1) th frame 101^, cannot be decoded in relation to 
time due to lacks or errors of the bit stream 1 04 occurring 
In burst. In this example, not only the PSC 105 corre- 
sponding to the (n+1 ) th frame In relation to time but also 
the following TR 1 06 are missed or in error It is therefore 
possible to correctly decode the GOB 1 027 in relation to 
space by establishing synchronization from the GBSC 
110 corresponding to the seventh GOB 1 027 In the (n+1 ) 
th frame 101^., In relation to time and decoding the fol- 
lowing GN 111, but impossible to specify whether this 
GOB 1027 positions in the nth frame or in the (n+1)th 
frame in relation to time. 

In terms of decoding of the eighth GOB 1023 
through the twelfth GOB 102^2 in the (n+l)th frame in 
relation to time, it is impossible to specify whether these 
GOBs 102 position in the nth frame or in the (n+1)th 
frame in relation to time. 

In consequence, if a part of the bit stream 104 is 
missed or an error occurs therein, it becomes impossi- 
ble to correctly decode all GOBs 102 in relation to time 
until synchronization of the next frame layer 101 5 is es- 
tablished. 

Further, the general method for encoding and de- 
coding digital moving picture signals has another draw- 
back that if the GOB 102 including a picture in motion 
in relatbn to time cannot be decoded, a picture quality 



3 



BNSOOCID: <EP ^0725545A2_I_> 



5 



EP 0 725 545 A2 



6 



of the reproduced picture is largely degraded. 

This problem will be described in more detail with 
reference to FIG. 5. FIG. 5 shows one frame including 
decoded signals of a moving picture, where a figure is 
moving in the center of the frame. In FIG. 5. a part mov- 
ing in relation to time is indicated by slanting lines, and 
the remaining part is a background which is still in rela- 
tion to time. A scene like this is general in TV conferenc- 
es, TV telephones or the like. 

Referring to FIG. 5, considering that any one of the 
first GOB 102t through the fourth GOB ^02^ cannot be 
decoded. The first through fourth GOBs 102^ through 

1024 include a picture still in relation to time. If the sec- 
ond GOB 1022 cannot be decoded, for example, a skill- 
tul operation is conducted to substitute the second GOB 
1022 present trame 101 with the second GOB 
1 022 preceding frame 1 0 1 in the decoding. With 
this operation, degradation of a picture quality in the sec- 
ond GOB 1022 of the present frame 101 may be hardly 
detected. 

However, it is a problem if decoding of the fifth 
through twelfth GOBs 1 025 through 1 02^2 shown in FIG. 
5 cannot be decoded. The fifth through twelfth GOSs 

1025 through 102^2 include a picture moving in relation 
to time. This means, for example, that a picture in the 
ninth GOB IO29 of the preceding frame IOI.t is largely 
different from the ninth GOB 102© of the present frame 
101 in relation to time. If the decoding of the ninth GOB 
1029 is unfeasible, degradation of the picture quality of 
the ninth GOB 1 029 of the present frame 1 01 is obvious- 
ly detected even if the skillful operation mentioned 
above is conducted in the decoding. 

Accordingly, if decoding of GOB 1 02 including a pic- 
ture moving in relation to time becomes unfeasible, a 
quality of a reproduced picture is largely degraded. 

In the light of the above problems, an object of the 
present invention is to provide a method for encoding 
and decoding digital moving picture signals, which can 
appropriately decode subframes (GOBs) following a 
subframe in trouble in relation to time if a part of a bit 
stream is missing or an error occurs in the bit stream. 

Another object of the present invention is to provide 
a method for encoding and decoding digital moving pic- 
ture signals, which can suppress degradation of a re- 
produced picture to a small extend it decoding of a sub- 
frame (GOG) including a picture in motion in relation to 
time becomes unfeasible. 

To accomplish the first object, the present invention 
is featured in that in the method for encoding and de- 
coding digital moving picture signals of this invention, 
time position information representing an order of dis- 
playing a subframe to an identifier of the subframe by 
which the subframe is identified. 

According to the method for encoding and decoding 
digital moving picture signals of this invention, time po- 
sition information representing an order of displaying a 
subframe is attached to an identifier used to identify the 
subframe and the identifier of the subframe is encoded. 



It is therefore possible to decode subframes following a 
subframe in trouble appropriately in relation to lime if a 
part of bit stream is missing or an error occurs in the bit 
stream by using the time position information represent- 

5 ing an order of displaying each of the subframes at- 
tached to an identifier used to identify the subframe 

To accomplish the second object, the present inven- 
tion is featured in that in the method for encoding and 
decoding digital moving picture signals of this invention, 

10 the number of blocks included in a subframe is varied 
according to a sum of quantities of generated informa- 
tion of the blocks included in the subframe so that each 
of all the subframes included in the frame has an equal 
sum of quantities of the generated information of the 

IS blocks included in the subframe. 

According to the method for encoding and decoding 
digital moving picture signals of this invention, the 
number of blocks included in a subframe is varied ac- 
cording to a sum of quantities of generated information 

20 of the blocks included in the subframe so that each of 
all the subframes included in the frame has an equal 
sum of quantities of the generated information of the 
blocks included in the subframe. In consequence, a spa- 
tial size of each subframe is not fixed. A subframe in- 

2S eluding a block having a large number of coding bits is 
in a smaller size, whereas a subframe including a block 
having a small number of coding bits is in a larger size. 
It is therefore possible to suppress degradation of a re- 
produced picture even if decoding of a subframe be- 

30 comes unfeasible since a subframe including a block 
which includes a motion in relation to time and is difficult 
to be encoded is in a smaller size in relation to space. 

FIG. 1 shows units to be encoded in a general en- 
35 coding method for encoding moving picture signals; 
FIG. 2 shows a bit stream generated in the genera! 
encoding method for encoding moving picture sig- 
nals; 

FIG. 3 shows a GOB layer in the bit stream in FIG. 
40 2 generated in the general encoding method for en- 
coding moving picture signals; 
FIG. 4 illustrates an effect of a lack or an error of a 
part of a bit stream occurring in the general encod- 
ing and decoding method for encoding and decod- 
es ing moving picture signals; 

FIG. 5 illustrates an effect of a lack or an error ot a 
part of a bit stream occurring in the general encod- 
ing and decoding method lor encoding and decod- 
ing moving picture signals; 
50 FIG. 6 shows a bit stream generated in a method 
for encoding digital moving picture signals accord- 
ing to first and second eml3odiments of this inven- 
tion; 

FIG. 7 is a flowchart illustrating the method for de- 
55 coding digital moving picture signals according to 
the first embodiment of this invention; 
FIG. 8 illustrates the method for encoding digital 
moving picture signals according to the second em- 
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bodiment ot this invention; and 

FIG. 9 shows a structure of subtrames according to 

the second embodiment of this invention. 

Hereinafter, description will be hereinafter made of 
embodiments according to the present invention refer- 
ring to the drawings. 

A method for encoding and decoding digital moving 
picture signals according to a first embodiment will be 
now described, which may correctly decode a subf rame 
as a. unit in relation to time even if a part of a bit stream 
is missing or an error occurs therein. 

In the encoding method according to this embodi- 
ment, one frame of digital motion picture signals is com- 
posed of, for example. 352 x 288 pixels. The frame is 
divided into twelve subf rames each composed of. for ex- 
ample, 176 X 48 pixels. Further, the subf rame is divided 
Into thirty three blocks 13 each composed of, for exam- 
ple. 16 X 16 pixels. 

The encoding method according to this embodi- 
ment corresponds encoded information for one frame to 
a spatial hierarchical structure made up of a frame 11, 
subf rames 1 2 and blocks 1 3 to generate a bit stream 1 4 
as shown, tor example, in FIG. 6. 

Meanings of encoded information of each layer 
shown in FIG. 6 are given below: 
Frame layer 1 1 S 

PSC (20 bits): a frame identifier 15; a unique code 
by which a decoding method can be always identi- 
fied, expressed as "0000 0000 0000 0001 0000"; 
Subf rame layer 1 2S 

SFSC (16 bits): a subf rame Identifier 16; a unique 
code by which a decoding method can be always 
identified, expressed as "0000 0000 0000 0001 "; 
SFNT (5 bits): a subf rame time number 17; indicat- 
ing a time position in which this subf rame 1 2 should 
be displayed; 

SFNS (4 bits): a subframe space number 18; indi- 
cating a spatial position in which the subframe 12 
should be displayed; 

SFQUANT (5 bits): quantization characteristic infor- 
mation 1 9; representing a quantization characteris- 
tic when a block 1 3 in the subframe 12 is encoded. 

Incidentally, encoded information 20 in the block 
layer 1 3S which is the lowest hierarchy in FIG. 6 is gen- 
erated in an encoding method of motion detection, pre- 
diction, orthogonal transform, quantization, variable 
length coding, etc., whose coding bit number are not 
fixed. 

Now referring to FIG. 7, a decoding method accord- 
ing to this embodiment will be now described. First, an 
FSC 15 which is an identifier of a frame layer IIS is 
found out from a bit stream 1 4 to establish synchroniza- 
tion of the frame layer IIS. 

After the establishment of synchronization of the 
frame layer 118. an SFSC 16 which is an identifier of a 



subframe layer 12S is found out from the following bit 
stream 14 to establish synchronization of the subframe 
layer 12S. Then a subframe time number SFNT 17 and 
a subframe space number SFNS 18 following the SFSC 
5 16 are examined. Next, a bit stream 14 of a block layer 
13S is decoded. A method for decoding this block layer 
13S is a procedure to regenerate the block in processes 
of, for example, variable length decoding, reverse quan- 
tization, reverse orthogonal transform, motion compen- 
10 sation, etc. Finally, the subframe 1 2 which is a set of the 
regenerated blocks 13 is placed In time and space po- 
sitions instructed by the SFNT 17 and the SFNS 18. if 
synchronization of the decoding is lost due to a lack of 
a part of the bit stream 1 4 or an error therein, a seek for 

fs the SFSC 16 which is an identifier of the subframe layer 
12S is started. A lack or an error of the bit stream 14 can 
be detected from, for example, that a decoded value ex- 
ceeds a range specified In advance or an unexpected 
code word appears when the bit stream 14 is decoded. 

20 When the SFSC 16 is detected and synchronization of 
the subframe layer 1 2S Is established, the SFNT 1 7 and 
the SFNS 18 are examined as stated above, the block 
layer 1 3S is decoded and regenerated, and the sub- 
frame 12 which is a set of the regenerated blocks 13 is 

25 placed In time and space positions instructed by the SF- 
NT 17 and the SFNS 18. 

According to the first embodiment of this invention, 
If a part of the bit stream 14 lacks or an error occurs in 
the bit stream 14. synchronization of the decoding is lost 

30 and the decoding becomes unfeasible, but correct de- 
coding becomes possible immediately after a subframe 
12 in trouble. 

As having been described the above first embodi- 
ment by way of an example, it is alternatively possible 
55 that the frame 1 1 , the subframe 1 2 and the block are in 
different sizes and shapes. A bit length of each encoded 
information may be different from that of the above en- 
coded inf omnation, or the frame layer 1 9 may be omitted, 
in addition. 

40 According to a second embodiment of this inven- 
tion, description will be now made of a method for en- 
coding digital moving picture signals which can sup- 
press degradation of a reproduced picture to a small ex- 
tent if a subframe including a picture moving in relation 

45 to time cannot be decoded. Incidentally, it is possible to 
here employ a decoding method similar to that of the 
first embodiment. 

In the encoding method of this embodiment, one 
frame 11 of digital moving picture signals is composed 

so of, for example. 352 x 288 pixels. The frame 11 is divided 
into blocks each composed of 16 x 16 pixels. In other 
words, one frame 1 1 is composed of 22 blocks x 1 8 block 
lines 21 . The block line 21 corresponds to the subframe 
12 mentioned above. 

55 In the encoding method of this embodiment, each 
block 13* Is encoded from the uppermost block line 21, 
as shown in FIG. 8, to generate encoded information. 
The encoded information of each bbck 1 3' is generated 
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in an encoding method of. for example, motion detec- 
tion, prediction, orthogonal transform, quantization, var- 
iable length coding, etc., the number of coding bits of 
which is not fixed. More specifically, the number of cod- 
ing bits of a block 1 3' which is difficult to be encoded is 
large, whereas the number of coding bits of a block 1 3' 
which is easy to be encoded is small. In the encoding 
method of this embodiment, a set of blocks 13 or 13' 
composes a subframe 12 (or a block line 21 ) which is a 
unit of encoding, but the number of blocks 13 or 13' in- 
cluded in one subframe 12 or 1 2' is not fixed. 

A manner of generating a bit stream 14 in the en- 
coding method of this embodiment and a structure of a 
subframe layer 1 2S will be now described with reference 
to FIG. 6. When one frame is encoded, an identifier of 
a frame layer is encoded, and an FSC 15 is placed in a 
bit stream 14. Next, the Identifier of the subframe layer 
12S, a time number and a space number of that sub- 
frame, and a quantization characteristic of that sub- 
frame are encoded together, and code words of an SF- 
SC 16, an SFNT 17, an SFNS 18 and an SFQUANT 19 
are placed in the bit stream 14. At the same time, block 
coding bit number integrated value B-add is set to zero. 
Following that, a block 13 is encoded and encoded in- 
formation of the block 13 composed of variable codes 
is placed in the bit stream 14. Concurrently, the coding 
bit number B of this block 1 3 is added to B-add, Namely, 
an equation, B-add = B-add + B, is computed. Similarly, 
blocks 13 are encoded successively, encoded informa- 
tion 20 of each block 13 is placed in the bit stream 14. 
and a calculation of B-add = B-add + B is repeated each 
time. If the B-add exceeds a subframe interval SFd 
when encoding of a certain block 12 is completed, an 
identifier of the subframe, a time number and a space 
number of that subframe and a quantization character- 
istic of that subframe are encoded, and code words of 
an SFSC 1 6, an SFNT 1 7, an SFNS and an SFQUANT 
19 are placed in the bit stream 14. At the same time, a 
block coding bit integrated value B-add is set to zero. In 
other words, a new subframe layer 128 is started to be 
formed from that point. 

The subframe interval SFd is set to, for example, 
540 bits. Therefore, if one frame is encoded with, for 
example, 6400 bits in the encoding method of this em- 
bodiment, 12 subframes 12 exist in one frame since 
6400/540 = 11.85. 

In the encoding method according to this embodi- 
ment, the number of blocks 13 included in a subframe 
12 is varied according to a quantity of generated infor- 
mation of the blocks included in one subframe, thereby 
varying a spatial size of the subframe 12, as stated 
above. More specifically, a subframe 12 including a 
block which is difficult to be encoded becomes small, 
whereas a subframe 12 including a block 13 which is 
easy to be encoded becomes large. FIG. 9 shows an 
example of a structure of subframes formed in the en- 
coding method of this embodiment. 

According to the second embodiment of this inven- 



tion, a subframe 12 including a block 13 which contains 
a motion in relation to time, and is thus difficult to be 
coac^d is made smaller in relation to space. II such sub- 
frame 12 cannot be decoded, it Is possible to suppress 
s degradation of a quality of a reproduced picture to a 
small extent. In a region within a frame in which no mo- 
tion in relation to time exists and degradation of the pic- 
ture quality is hardly detected even if the decoding is 
unfeasible, a size of one subframe is large in relation to 
space, which allows a less volume of side information 
such as the subframe identifier SFSC 16, subframe 
number SFNT 16 and subframe number SFNT 17. This 
can prevent an encoding efficiency from being lowered. 

As having been described the second embodiment 
by way of an example, it is alternatively possible that the 
frame 11 , subframe 12 and the block 13 are in different 
sizes and shapes. It is also possible to employ values 
of a quantity of codes of one frame and a subframe in- 
terval SFD different from those employed In the above 
example. 

As obvious from the above embodiments, this in- 
vention enables correct decoding of each subframe 12 
as a unit in relation to time even if a part of the bit stream 
14 is missing or an error occurs therein. 

Further, according to this invention, it is possible to 
suppress degradation of a quality of the reproduced pic- 
ture to a small extent if a subframe 13 including a block 
which is in motion in relation to time cannot be decoded. 

Still further, in a region within a frame in which no 
motion in relation to time exists and degradation of a 
quality of the reproduced picture quality is hardly detect- 
ed even if the decoding is unfeasible, side information 
of the region is allowed to be in a small volume so that 
it is possible to prevent an encoding efficiency from be- 
ing lowered. 



Claims 

1 . A method for encoding digital motion picture signals 
of a frame, comprising the steps of: 

dividing said frame into plural blocks each in- 
cluding N X M pixels; 

forming a subframe composed of a set of said 
blocks, said subframe being a unit to be encod- 
ed; 

setting an identifier to said subframe to identify 
said subframe; and 

adding time position information representing 
an order of displaying said subframe to said 
identifier and encoding said time position infor- 
mation along with said subframe. 

2. A method as claimed in claim 1, including varying 
the number of said blocks included in said subframe 
according to a quantity of generated information of 
each of said blocks. 
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A method for encoding digital motion picture signals 
of a frame, comprising the steps of: 

dividing said frame into plural blocks each in- 
cluding N X M pixels; s 
forming a subframe composed.of a set of said 
blocks, said subframe being a unit to be encod- 
ed; and 

varying the number of said blocks included in 
said subframe according to a quantity of gen- io 
erated information of each of said blocks. 

A method for encoding digital motion picture signals 
of a frame according to claim 1 , 2 or 3, wherein each 
of said subframes included In said frame has an is 
equal sum of quantities of generated information of 
said blocks included in said subframe. 

A method for encoding digital motion picture signals 

of a frame, comprising the steps of: 20 

dividing said frame into plural blocks each in- 
cluding N X M pixels; 

forming a subframe composed of a set of said 
blocks, said subframe being a unit to be encod- 2S 
ed; 

setting an identifier to said subframe to identify 
said subframe; 

adding time position Information representing 
an order of displaying said subframe to said 30 
Identifier and encoding said time position infor- 
mation along with said subframe; and 
decoding each of said subframes appropriately 
in relation to time by decoding and using said 
time position information to form said frame of ss 
said digital moving picture signals. 

A method for encoding and decoding digital motion 
picture signals of a frame, according to claim 5, 
wherein the method further includes the step of var- 40 
ying the number of said blocks Included In said sub- 
frame according to a quantity of generated informa- 
tion of each of said blocks. 

A method for encoding digital motion picture signals 4S 
of a frame, comprising the steps of: 

dividing said frame into plural blocks each in- 
cluding N X M pixels; 

forming a subframe composed of a set of said so 
blocks, said subframe being a unit to be encod- 
ed; 

varying the number of said blocks included in 
said subframe according to a quantity of gen- 
erated information of each of said blocks; and ss 
decoding each of said subframes to form said 
frame of said digital moving picture signal. 



8. The method for encoding and decoding digital mo- 
lion picture signals of a frame according to claim 5. 
6 or 7. wherein each of said subframes Included In 
said frame has an equal sum of quantities of gen- 
erated information of said blocks included in said 
subframe. 



7 



.0725545A2_I_> 



EP 0 725 545 A2 



FIG. 1 
PRIOR ART 



102- 



FRAME 
LAYER 
101S 



352 PIXELS 



103- 

SUBFRAME 
LAYER 
102S 



MACRO BLOCK 

LAYER 

103S 



- 1 




2 




3 




4 




5 




6 




7 




8 




9 




10 




11 




12 





101 

FRAME 



tx 



288 PIXELS 
102 

I ■ 'r-^i /SUBFRAME(GOB) 

-1 — i- — r — I — I — I — 1 — t — 
I i I I i I I I 

-rr*i~rT^rr-t"n48 pixels 



176 PIXELS 



103 



16 \ 
PIXELS\ 



103 
BLOCK 

16 PIXELS 



BNSDOCID: <EP 0725545A2J_> 



8 



\ 



EP 0 725 545 A2 




o- 



co 

O- 



LU 
Q- 



CO 

o 
cr 

HI 
LU 

< 

QC 



LO 

o- 



I 



o 

CO 

QL 



CO 
CO 



CO 
CD 

m 



CO 

CQ 

O 
C\J 




CsJ 



CvJ 



< 

O 



CO ^ 
CM 

o 
cr 

LU 

It- 

LU 

< 

QC 

m 

CO 

o 



C3 



O 
CO 
CD 

o 



CO 
CD 

in 



CO 
03 



CO 

CD 
CO 




< i 
LU 

QDCoi:^ 



9 



BNSOCX:iD: <EP 0725545A2J_> 



EP 0 725 545 A2 



CDOC 



CO 



CM 



CO ^ 
CM 

o 

cr 
ui 

Lit 

< 

U- 

CQ 

W 

CD 
O 
CD 



LJU 
CO 

< 

CO 
O 



CO 

CD 
CO 



LU 

o 



CD 



< 

O 
CS. 



I 



I 



CO 
t 
CD 

in 



CO 

t: 

CD 



o 

CO 
CD 
CD 

T 



CO 

CD 
CD 



CM 

VO 



CQ 



r 



OuJ< 

< :5 

i|i 

CMCD^ 



I 



oil 

OUJ< 

^^^^ 



CO 
UJCD 



Si 



CO 

LU CD 




CO 

CO 

o 



7 



BNSOOCID: <EP ^0725545A2_I_> 



10 



EP 0 725 545 A2 



SUBFRAME 
(GOB) 



FIG. 4 
PRIOR ART 



FRAME n 
(TR=n) 



FRAM n+1 
(TR=n+1)) 



SUBFRAME 
(GOB) 




UNDECOBABLE SUBFRAME DUE TO A LACK 
>y. OR AN ERROR IN THE BIT STREAM 




BNSDOCID: <EP ^0725545A2_I_> 



11 



EP 0 725 545 A2 



CO 



CO 




00- 



LU 



CO 
CVJ 

cc 

LU 
< 

UJ 

< 

cc 

LL 
CD 

CO 



co- 




oc 

LU 

< 

-J 

O 

o 

—I 
m 



< 
o 

CO 



I 



CO 

lo- 
co 



I 



CO 



I 



o 

CO 
Li- 
CO 

T 



CD 

in 



CO 
CD 



CO 

tn 



CO 

t: 

CD 




"7 



< 
LU 

CDCO 



12 



BNSOOCID: <EP_ 



.072554SA2_L> 



EP 0 725 545 A2 



FIG. 



START ^ 




CHECKING 


SFNT 1 




CHECKING 


SFNS 1 



IS 

VNY CONFLIC1 
IN SFNT & SFNS, 

7 



lYES 



NO 



DECODING BIT STREAM OF 
BLOCK LAYER 



IS 

"ANY CONFLICr 
IN THE DECODING OF THE 
BLOCK LAYER 
9 



NO 



NO 



IS 

IDNE SUBFRAME^ 

XiOMPLETECL 
? 

Tyes 



PLACING THE SUBFRAME 
ACCORDING TO SFNT & SFNS 




X 



EP 0 725 545 A2 



21- 

21 



FIG. 8 

13' 13' 352 PIXELS 
^ ^ (22 BLOCKS) 

q ^tS-ajLi 



2 



21-^ 



288 PIXELS 
(18 BLOCK 
LINES) 



FIG. 9 



12i 




12i2 



PART IN MOTION 



14 



BNSDOCID: <EP ^0725545A2J_> 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(11) EP 0 725 545 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

27.01.1999 Bulletin 1999/04 

(43) Date of publication A2: 

07.08.1996 Bulletin 1996/32 



(51) Intel 6; H04N 7/26, H04N 7/64, 
H04N 7/50 



(21) Application number: 96300623.4 

(22) Date of filing: 30.01.1996 



(84) Designated Contracting States: 


(72) Inventor: Machida, Yutaka 


DE FR GB 


Yokohama (JP) 


(30) Priority: 31.01.1995 JP 14514/95 


(74) Representative: 




Dempster, Benjamin John Naftel et al 


(71) Applicant; MATSUSHITA ELECTRIC INDUSTRIAL 


Withers & Rogers, 


CO., LTD. 


4 Dyer's Buildings, 


Kadoma-shI, Osaka 571-8501 (JP) 


Hoi born 




London EC1N 2QP (GB) 



(54) A method for encoding and decoding moving picture signals 



(57) In the method for encoding and decoding digital 
moving picture signals of this Invention, information for 
one frame is encoded correspondingly to a spatial hier- 
archy of a frame, subframes and blocks. A subframe 
time position number and a subframe space number are 



attached to an identifier of each of the subframes. 
Thereby appropriate decoding of the subframes can be 
resumed immediately after an error occurs. The sub- 
frame identifiers are placed at a certain interval in the 
bit stream. 



CO 
< 

in 
in 

lA 
CM 

o 

o. 
liJ 



FIG. 6 



BIT 

STREAM 
14 



FRAME LAYER 11S 



c 



FSC 



20 BITS 



SUBFRAME 
LAYER 




SUBFRAME LAYER 12S 

16 17 



16 BITS 5 BITS 
BLOCK LAYER 13S 



18 



4 BITS 



5 BITS 



BLOCK 

ENCODED 

INFORMATION 



UNDEFINED 
LENGTH BITS 



Prinlecf by Jouve, 75001 PARIS (FR) 



13S 



'*\ SFSC {-^ SFNT \^ SFNS j^SFQUANT ^>^BLOCK LAYER 



J->^BLOCK LAYER 



BNSOOCIO: <EP ^0725545A3.I_> 



EP 0 725 545 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Numter 

EP 96 30 0623 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citatton of document with indieation, where appropriate, 
of reievani passages 



Relevant 
loolatm 



CLASStFICATION OF THE 
APPUCATION (tnLCI.6) 



X 

Y 



Y 
A 



US 5 287 178 A (ACAMPORA ALFONSE A ET AL) 
15 February 1994 

* column 7, line 50 - column IG, line 64 * 

* figures 5-7 * 

EP 0 552 049 A (SHARP KK) 21 July 1993 

* column 5, line 54 - column 6, line 48 * 

* column 8, line 55 - column 10, line 25 * 

* abstract; figures 4-6 * 

BE 2 287 603 A (FUJITSU LTD) 
20 September 1995 

* page 9, line 24 - page 10, line 1 * 

* page 14, line 13 - line 19 * 

* page 20, line 18 - line 21 * 

* abstract; figures 6,7 * 

"CODEC FOR AUDIOVISUAL SERVICES AT N X 
384 KBIT/S- 

COMITE CONSULTATIF INTERNATIONAL 
TELEGRAPHIQUE TELEPHQNIQUE RECOMMENDATION, 
vol. 3, no. 111.06, 14 November 1988, 
pages 120-128, XP000575342 

* section 4 * 

-TRANSMISSION OF NON-TELEPHONE SIGNALS. 
INFORMATION TECHNOLOGY - GENERIC CODING OF 
MOVING PICTURES AND ASSOCIATED AUDIO 
INFORMATION: VIDEO- 
ITU-T TELECOMMUNICATION STANDARIZATION 
SECTOR OF ITU, July 1995, pages A/B, 
I -VI II, 1 - 201, XPO0O198491 

* section 6.1.2, pages 20-21 * 

* section 6.2-4, page 34 * 

* section 6.3.16, pages 58-59 * 

* sections D. 13.2.1, D.13.2.2, page 166 * 



1,5 

2-4,6-8 



2-4,6-8 
1.5 



3,4,7,8 



H04N7/26 
H04N7/64 
H04N7/50 



1-8 



TECHNICAL FIELDS 
SEARCHED (IntXLB) 



H94N 



1-8 



The present search report has been drawn up tor aD claims 



Piac* d March 

THE HAGUE 



Dal* of conpletam a( th« »Mrcn 

4 December 1998 



La. V 



CATEQORY OF cn-ED DOCUMENTS 

X : partioulaify nim^mM it tak*n «Jom 

Y : pvtoula/ly r»»«» «n l if oontMnvd wiOi anothar 

doourMnt of thm nmrnm o«i»gory 
A : tMshnolodioal baokgraund 
O : non-written dmotosur* 
P: 



T : theory erprineipl* und*r1ying th« fciv*ntion 
E : ■«ri«r p«icnt dooumMt, but piiblimh»d on, c 

■fterth* filing date 
O : dootimMit cited in the uppli o a tion 
L : dooumant cited lor ottiar raaaens 



li : maR*>«r of tha aamo peteni family, coneapomSng 



2 



BNSDOCID: <EP ^0725545A3J_> 



